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FOREWORD 


Training  Technology  Field  Activities  (TTFAs)  have  the  mission  of  developing 
and  implementing  training  technology  in  the  Army.  Each  TTFA  is  a  partnership 
effort  consisting  of  the  Army  Research  Institute  (ARI),  and  the  U.S.  Army  TRADOC 
Training  Technology  Agency  (TTA),  and  an  Army  school  or  other  training  organiza¬ 
tion.  The  Fort  Lee  UFA  has  as  a  third  partner,  the  U.S.  Army  Quartermaster 
School  ( QMS ) »  The  focus  for  the  initial  development  and  implementation  effort 
is  the  76C10  course  (Equipment  Records  and  Parts  Specialist). 

An  early,  mutually  recognized  need  was  to  develop  procedures  for  improved 
76C  performance  measurement.  This  serves  two  objectives.  First,  it  permits 
monitoring  of  student  performance  over  time  to  determine  if  the  introduction  of 
training  technology  is  having  the  desired  effect — improvement  of  student  per¬ 
formance.  Second,  when  introduced  in  conjunction  with  an  automated  system, 

It  will  reduce  instructor  workload  while  improving  the  diagnosis  of  student 
problems.  This  report  describes  the  development  of  those  procedures. 

The  research  was  performed  by  the  Training  and  Simulation  Technical  Area, 
Training  Research  Laboratory,  under  Research  Task  3.3.3.,  Application  of  Technology 
to  Meet  Supply  Skills  Training  Needs.  It  is  in  response  to  a  Memorandum  of  Agree¬ 
ment  between  TRADOC,  ARI,  and  QMS  (Establishment  of  a  Training  Technology  Field 
Activity,  Fort  Lee,  VA)  dated  6  January  1984.  Results  were  briefed  to  represent¬ 
atives  of  the  Quartermaster  School  and  TRADOC  TTA  on  23  April  1987.  Planning 
for  implementation  of  the  testing  procedures  in  the  76 C  course  is  underway. 
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INTRODUCTION 


Background 

As  part  of  the  on-going  Training  Technology  Field  Activity  (TTFA)  at 
the  Quartermaster  School  (Fort  Lee),  new  training  methods  and  technologies 
are  being  applied  to  the  76C  Equipment  Records  and  Parts  Specialist  Ad¬ 
vanced  Individual  Training  (AIT)  course  and  to  on-the-job  training  in  the 
76C  MOS.  In  this  situation,  the  accurate  assessment  of  the  impact  of 
these  course  modifications  on  trainee  performance  in  the  school  and  on  the 
job  is  essential.  In  order  to  measure  the  effects  of  such  course  changes 
performance  measures  must  be  developed,  when  not  in  existence,  which  can 
provide  a  valid  index  of  trainee  skills. 

The  development  of  performance  measures  for  the  76C  AIT  should  be  con¬ 
ducted  with  several  objectives  in  mind.  First,  the  performance  measure 
should  reliably  reflect  the  trainee's  ability  to  perform  the  critical 
tasks  established  by  the  Quartermaster  School.  Secondly,  an  evaluation 
should  be  conducted  to  determine  whether  additional  job  tasks  are  critical 
for  successful  performance  and  if  so,  will  the  performance  measures  relia¬ 
bly  assess  trainee  knowledge  in  these  areas.  Third,  the  performance  meas¬ 
ures  need  to  be  scorable  in  a  consistent,  objective  fashion.  This  is 
particularly  the  case  if  these  measures  are  to  be  placed  within  a 
computer-managed  Instructional  (CMI)  system  in  which  trainees  would  take 
the  test  on  a  computer  which  would  score  it  automatically.  Fourth,  it 
would  be  desirable  for  the  tests  to  have  some  predictive  utility  in  as¬ 
sessing  the  level  of  performance  which  the  trainee  will  exhibit  on  the 
job. 


The  whole  question  of  the  validity  or  predictive  utility  of  76C  per¬ 
formance  tests  is  an  important  element  in  reducing  what  has  become  known 
as  the  transition  problem.  As  Keesee  et  al  (1980)  have  noted,  the  transi¬ 
tion  from  76C  AIT  to  performing  in  the  unit  has  proven  difficult  for  76C 
trainees.  There  are  several  apparent  reasons  for  the  transition  problem: 
(1)  76C  AIT  graduates  often  work  by  themselves  in  a  motor  pool  and  have  no 
one  to  go  to  for  answers  about  supply  procedures,  (2)  post-specific  (lo¬ 
cal)  procedures  for  ordering  parts  and  maintaining  a  prescribed  load  list 
(PLL)  create  some  divergence  between  what  76C  trainees  have  beeu  taught 
and  what  they  must  actually  do,  and  (3)  there  is  a  low  system  tolerance 
for  error  in  parts  orders. 

Valid  performance  tests,  based  on  front-end  analyses,  can  help  reduce 
the  difficulty  of  school- to-un it  transition  by  accurately  assessing  defi¬ 
ciencies  in  trainee  knowledges  and  skills  essential  for  successful  job 
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performance  under  the  aforementioned  condition*.  In  addition ,  tho  per¬ 
formance  test  can  guide  the  development  of  appropriate  instructional  mate¬ 
rials  to  Insure  that  training  is  given  on  the  requisite  jobs  skills. 

This  report:  (1)  presents  a  methodology  for  the  construction  of  sec¬ 
tion  or  annex  tests  for  the  four  major  76C  duty  positions,  i(2)  describes 
the  application  of  the  aethodology  as  used  in  the  development  of  duty  po¬ 
sition  tests,  and  (3)  describes  an  example  test  plan  and  validation  proce¬ 
dures  for  use  in  future  test  development. 

Methodology  for  76C  Test  Construction 


Job  Analysis 

The  initial  step  in  test  development  is  an  analysis  of  the  entry  level 
job  which  trainees  will  be  expected  to  perform.  Keesee  et  al  (1980)  note 
that  the  76C  AIT  graduate  is  expected  to  perform  as  a  journeyman  because 
their  supervisor  is  not  in  the  same  MOS  (e.g.,  a  76Y  or  motor  pool  ser¬ 
geant)  and  is  not  necessarily  at  a  higher  skill  level.  While  this  makes 
it  more  difficult  for  the  trainee  when  first  assigned  to  a  unit,  it 
obviates  the  necessity  for  distinguishing  between  the  tasks  performed  by 
76C  clerks  with  different  levels  of  experience  since  they  are  all  assigned 
the  same  tasks. 

The  Supply  and  Service  Career  Management  Field,  including  the  76C  MOS, 
has  been  the  focus  of  a  number  of  recent  job  and  task  analyses  (Hughes 
Aircraft,  1981;  Duncan,  1984;  T&ADOC,  1983).  Thus,  it  was  unnecessary  to 
conduct  a  separate  job  analysis  for  the  current  project.  However,  in 
order  to  clarify  certain  aspects  of  the  task  environment,  interviews  were 
conducted  with  several  PLL/TAMMS  clerks  at  Fort  Lee  and  Fort  Carson  as 
well  as  with  Instructors  in  the  76C  AIT  program  at  the  Quartermaster 
School. 

The  most  useful  job  analysis  for  the  current  purpose  is  the  job  analy¬ 
sis  described  in  Duncan  (1984)  which  was  conducted  by  RCA  Services  and  Edu¬ 
cational  Testing  Service  as  part  of  the  Baseline  Skills  Education  Project 
(BSEP).  Critical  tasks  were  analyzed  in  Skill  Level  10  and  20  for  the  94 
highest  density  MOSs  including  76C.  The  objective  was  to  identify  pre¬ 
requisite  competencies  or  skills  needed  for  successful  performance  of  the 
critical  tasks  in  each  MOS.  Task  lists  were  developed  from  existing  mate¬ 
rials  such  as  course  manuals  and  task  lists  from  proponent  schools.  In 
conjunction  with  subject  matter  experts  (SME)  the  job  analysis  identified: 
(1)  the  specific  job  or  performance  steps  required  to  perform  each 
task, (2)  the  equipment  required,  (3)  the  knowledges  and  skills  necessary 
and,  (4)  the  standards  to  which  the  completed  tasks  should  conform.  Dis¬ 
crepancies  between  actual  field  performance  and  doctrinal  procedures  were 
noted  and  researched. 


^The  four  duty  positions  are  Prescribed  Load  List  (PLL)  Clerk,  The  Auto¬ 
mated  Motor  Maintenance  System  (TAMMS)  Clerk,  Shop  Clerk,  and  Shop  Stock 
Clerk. 


The  results  of  the  job  analyses  mentioned  previously  indicate  that 
several  aspects  of  the  job  environment  cause  particular  problems.  The 
lack  of  adequate  supervisory  technical  expertise  means  that  the  76C  must 
be  more  proficient  at  finding  information  in  technical  manuals.  Also  the 
differences  between  school  and  local  post  procedures  increase  the  impor¬ 
tance  of  the  76C  having  a  better  understanding  of  the  nature  and  rationale 
of  their  job  activities.  Many  of  the  differences  between  school  and  job 
practices  can  be  easily  accommodated  if  the  nature  of  the  activity  is  well 
understood.  However,  because  current  training  emphasizes  that  record 
keeping  and  supply  procedures  are  to  be  performed  in  one  specific  way, 
there  is  interference  when  AIT  graduates  have  to  perform  the  activity  in  a 
slightly  different  way.  In  addition,  the  AIT  graduates  express  concern 
about  the  differences  because  they  believe  that  the  procedures  taught  in 
school  are  the  only  correct  way  of  performing  these  activities.  In  con¬ 
sideration  of  these  points,  it  would  seem  important  to  test  trainee  per¬ 
formance  on  job  comprehension,  ability  to  look  up  information,  and  the 
degree  to  which  minor  variations  in  procedures  can  be  assimilated  without 
undue  disruption  in  addition  to  the  baBlc  subject  matter  of  supply  form 
completion.  These  considerations  in  tandem  with  the  job  procedures  them¬ 
selves  will  guide  the  formulation  of  types  of  items  that  can  best  measure 
the  knowledges,  skills  and  abilities  (KSAs)  essential  to  successful  76C 
performance. 

To  ensure  the  performance  tests  accurately  reflect  the  full  domain  of 
76C  tasks  and  functions,  test  plans  should  be  constructed  for  each  of  the 
annexes  of  the  AIT  course.  The  test  plan  specifies  the  knowledge  and  task 
domain  which  is  to  be  covered,  the  type  of  test,  items  to  be  used,  and  the 
length  and  overall  structure  of  the  test.  In  the  present  case,  the  test 
plans  are  meant  to  serve  as  the  model  for  end-of-annex  and  end-of-course 
test  construction. 

The  test  plans  provide  a  division  of  the  duty  positions  into 
functional  areas  (the  columns  of  the  test  plan  matrix)  and  the  knowledges 
and  actions  required  to  correctly  perform  those  functions  (the  rows  of  the 
test  plan).  A  more  complete  description  will  be  provided  In  a  later  pub¬ 
lication  entitled  Test  Plan  for  the  76C  AIT  Duty  Position  Annexes,  but  a 
brief  example  here  should  clarify  their  role  in  guiding  performance  meas¬ 
urement. 

In  looking  at  the  test  plan  for  the  PLL  manual  annex  (Figure  1),  the 
main  functional  area  tasks  of  the  duty  position  can  be  seen  in  the  column 
headings,  e.g.,  Request  for  issue  of  national  stock  number  (NSN)  parts. 

The  row  headings  indicate  the  possible  knowledges  and  activities  required 
to  successfully  perform  these  functions,  e.g.  definitions  of  terms  or  how 
to  pos t  the  information  from  one  supply  document  to  another.  The  cells  of 
the  matrix  cover  the  entire  domain  of  the  PLL  manual  job.  (It  should  be 
noted  that  not  all  of  the  cells  are  meaningful,  e.g.  repairable  exchange 
of  parts  does  not  involve  postings). 
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Information  in  Appendix  A  and  materials  available  from  the  author 
provide  a  compilation  of  data  extracted  from  the  on-line  data  base  devel¬ 
oped  for  the  BSEP  project.  The  critical  tasks  for  the  76C  MOS  are  listed 
in  Appendix  A.  The  component  elements  for  each  of  the  critical  tasks  are 
available  upon  request.  These  component  elements  are  paired  with  the 
codes  for  the  prerequisite  competencies  and  the  corresponding  codes  are 
also  available  upon  request. 

Test  Plan  Development 

Given  the  identification  of  the  critical  tasks  and  the  skills  required 
for  their  performance,  the  next  step  is  the  development  of  the  test  plan. 
The  test  plan  can  be  considered  as  a  template  for  the  construction  of 
alternate  versions  of  a  particular  performance  test  so  that  there  is  a 
high  degree  of  content  consistency  between  alternate  versions.  When  the 
content  of  the  performance  test  closely  resembles  and  samples  actual  job 
tasks  and  duties  (i.e.,  possesses  content  validity)  the  linkage  between 
the  items  used  in  the  tests  and  the  tasks/duties  of  the  job  does  not  re¬ 
quire  the  documentation  (e.g.  SME  panel  ratings)  that  would  be  necessary 
if  the  items  were  more  abstractly  related  to  job  performance  (e.g.,  apti¬ 
tude  tests). 

The  test  plan  specifies  the  kind  and  number  of  items  which  will  be 
used  to  measure  trainees'  knowledge  of  how  to  perform  the  identified 
critical  tasks  and  the  skills  associated  with  their  successful  perform¬ 
ance.  In  the  present  case,  the  BSEP  study  identified  39  critical  tasks 
for  the  76C  MOS  which  cover  the  four  duty  positions  of  the  76C  MOS.  In 
any  one  annex  therefore,  the  number  of  critical  tasks  to  be  covered  is 
only  a  part  of  the  total  of  39  tasks.  This  allows  the  performance  test 
for  each  course  annex  to  contain  a  complete  representation  of  the  relevant 
critical  tasks. 

The  content  of  the  end-of-annex  tests  must  be  based  on  the  information 
taught  in  the  annex.  For  purpose  of  prediction,  however,  the  test  items 
must  also  reflect  the  critical  performance  requirements  of  the  job  envi¬ 
ronment.  Basing  the  test  content  on  the  subject  matter  covered  in  the 
annex  does  not  require  explanation.  Taking  into  account  the  performance 
requirements  of  the  job  situation  with  respect  to  these  tasks,  however,  is 
a  more  difficult  issue.  It  is  not  possible  or  necessarily  desirable  to 
exactly  reproduce  the  job  context  in  the  training  environment.  Those 
aspects  of  the  job  which  seem  to  present  the  greatest  difficulties  for  the 
new  AIT  graduate  deserve  the  most  attention. 
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TEST  PLAN  FOR  THE  PLL  ANNEX 
(Multiple  Choice  I  tens) 
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Figure  1 


Test  items  for  the  FLL  manual  duty  position  should  be  developed  for 
all  applicable  cells  of  the  test  plan.  Each  test  should  include  an  appro¬ 
priate  sample  of  items  from  this  total  pool,  with  the  sample  based  on  the 
weighting  (if  any)  of  the  different  functional  areas.  If  all  areas  have 
the  same  weight,  then  approximately  equal  numbers  of  items  of  the  test 
should  come  from  each  of  the  functional  areas.  If  one  area  is  given  a 
weight  of  l.S,  then  half  again  as  many  test  items  should  come  from  that 
column. 

When  the  test  plan  is  integrated  into  a  CMI  system,  the  instructors 
will  have  the  ability  to  make  very  fine  grained  evaluations  of  trainee 
comprehension  and  memory  for  the  different  duty  position  content  areas. 
Since  each  test  item  is  tied  to  a  particular  cell  of  the  test  matrix, 
summary  tables  can  be  created  which  describe  the  pattern  of  errors  made  by 
the  trainee  on  the  test.  In  other  words,  errors  are  summed  along  the  rows 
and  columns  of  the  matrix,  thus  providing  a  clear  measure  of  error  clus¬ 
ters  along  any  particular  row  or  column.  Such  a  cluster  would  indicate  a 
major  area  of  trainee  weakness.  For  example,  if  a  trainee  had  7  errors  on 
the  PLL  manual  test  and  4  of  them  were  on  items  from  Column  4,  this  would 
indicate  trainee  weakness  in  PLL  maintenance  procedures.  Of  course,  the 
CMI  system  will  be  able  to  make  such  analyses  for  each  of  the  trainees 
immediately  available  after  all  the  test  answers  have  been  entered. 

Item  Construction 


Once  the  test  plan  has  been  constructed  and  the  item  types  and  their 
relative  weights  specified,  then  item  construction  and  validation  can 
begin.  Subject  matter  experts  generate  items  whose  characteristics  meet 
those  specified  in  the  test  plan.  The  number  of  items  generated  is 
roughly  3  to  4  times  greater  than  the  total  number  needed  so  that  at  least 
one  alternate  test  form  can  be  developed. 

When  enough  items  have  been  developed,  they  should  be  tried  out  on  a 
pilot  basis  with  personnel  curiently  filling  76C  duty  positions  and/or 
with  trainees  currently  enrolled  in  the  AIT  course.  Point  biserial  corre¬ 
lations  or  other  appropriate  statistical  analyses  should  be  performed  on 
the  overall  test.  The  objective  is  to  define  the  difficulty  level  (the 
number  of  test- takers  correctly  answering  the  item)  and  its  discriminative 
power  (the  number  of  trainees  scoring  in  the  top  50%  on  the  test  who  pass 
the  item  compared  to  the  number  of  trainees  scoring  in  the  bottom  50%  who 
pass  the  item).  The  test  should  have  items  ranging  in  difficulty  (e.g., 
10%  to  90%  passing  rates)  which  best  differentiate  high  and  low  performing 
trainees  at  each  level  of  difficulty. 
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Unlike  aptitude  tests,  an  achievement  test  such  as  the  end-of-annex 
test  considered  here  cannot  contain  items  solely  on  the  basis  of  their 
psychometric  properties  since  there  are  particular  competencies  which  must 
be  exhibited  by  all  AIT  trainees.  However,  it  is  highly  useful  to  have  a 
substantial  proportion  of  test  items  on  which  a  range  of  performance  can 
be  expected  because  it  can  then  serve  as  a  predictive  instrument  for  suc¬ 
cess  on  the  job  and  in  further  training. 


Since  the  purpose  of  TTFA  is  to  experimentally  evaluate  the  effect  of 
new  methods  and  training  technology  on  course  and  job  performance,  it  is 
necessary  to  have  a  reliable  criterion  measure  which  can  be  used  as  a 
yardstick  for  such  evaluations.  The  examinations  currently  being  used  in 
the  classroom  were  not  Intended  for  this  use  and  suffer  from  severe  re¬ 
striction  of  range  effects  which  limit  their  use  as  criterion  measures. 
The  restriction  in  range  of  the  scores  occurs  through  the  testing  proce¬ 
dures  currently  used  which  permit  test  retakes. 


After  the  pilot  testing  and  psychometric  validation  of  the  test  items 
have  been  completed  and  sets  of  items  sufficient  to  form  two  alternate 
forms  of  the  test  specified  in  the  test  plan  have  been  selected,  the  vali¬ 
dation  of  the  test  as  a  predictor  of  performance  should  be  conducted.  The 
objective  is  to  determine  whether  trainees  who  score  well  on  the  test  will 
also  perform  well  on  the  job  or  in  situations  which  are  highly  similar  to 
the  assigned  job. 


There  are  a  number  of  ways  to  establish  the  validity  of  a  performance 
test.  Trainees  can  be  followed  to  the  job  and  their  performance  corre¬ 
lated  with  their  test  scores.  Alternatively,  a  group  of  current  76C  per¬ 
sonnel  can  take  the  test  and  their  test  scores  would  be  correlated  with 
their  job  proficiency.  If  validation  has  to  be  undertaken  completely 
within  the  context  of  the  training  environment,  then  the  trainee  scores  on 
the  end-of-annex  tests  can  be  validated  against  trainee  performance  on  the 
appropriate  components  of  the  end-of-course  performance  exercise.  The 
end-of-course  exercise  involves  performance  in  a  simulated  motor  pool 
environment. 


PLL  and  Shop  Stock  Validations 


A  preliminary  item  validation  effort  for  PLL  and  Shop  Stock  end-of 
annex  testR  composed  of  multiple  choice  items  was  conducted  at  Fort  Lee, 
VA  and  Fort  Lewis,  WA.  The  multiple  choice  items  were  given  to  groups  of 
76C  personnel  who  had  to  answer  them  under  conditions  similar  to  those  in 
the  76C  AIT,  i.e.,  access  to  DA  Pam  7 1 0—2—1  (supply  update)  was  permitted 
but  collaboration  on  answers  was  not. 


The  PLL  Clerks  and  Shop  Stock  Clerks  surveyed  were  able  to  complete 
the  tests  In  a  maximum  o£  60  minutes.  The  subjects  were  currently  working 
in  the  appropriate  duty  position  and  had  been  assigned  to  that  position 
not  less  than  6  months  nor  more  than  4  years  ago.  No  significant  differ¬ 
ences  on  test  performance  were  found  as  a  function  of  different  biographi¬ 
cal  characteristics  but  the  sample  size  (n*27  at  Fort  Lee,  n-28  at  Fort 
Lewis)  was  relatively  small  and  may  have  obscured  differences. 

Biserial  correlations  (between  item  success  and  full  test  success) 
were  computed  for  each  of  the  test  items  on  the  two  end-of-annex  tests 
(cf.  Appendix  B.)  On  the  PLL  test,  23  of  the  42  items  had  biserial  corre¬ 
lations  greater  than  the  criterion  of  r*.20  for  acceptable  psychometric 
properties.  On  the  Shop  Stock  test,  28  of  the  47  items  had  biserial  cor¬ 
relations  greater  than  the  criteria  of  r*».2Q.  (For  test  security  reasons 
the  items  cannot  be  listed  here). 

The  remainder  of  the  items  fell  into  two  categories:  (1)  items  with 
very  high  pass  rates  and  (2)  items  with  low  pass  rates  and  equivalent 
performance  between  high  and  low  scorers.  Since  the  end-of-annex  tests 
are  achievement  tests,  certain  knowledges  must  be  demonstrated  by  all 
trainees.  Thus,  all  items  cannot  be  included  solely  on  their  capacity  as 
differential  predictors  of  performance.  For  this  reason,  13  items  with 
low  biserial  correlations  due  to  high  pass  rates  were  included  since  they 
cover  essential  actions  of  the  duty  position.  The  items  falling  into  the 
second  category  were  basically  items  which  for  various  reasons  the 
test-takers  found  to  be  confusing,  inaccurate,  or  not  in  total  accordance 
with  customary  procedures.  All  of  these  (6)  items  were  discarded  as  defi¬ 
cient. 

This  pilot  testing  permitted  the  development  of  final  versions  of  the 
PLL  (manual)  and  Shop  Stock  Clerk  multiple  choice  tests  to  be  used  in  TTFA 
evaluations  and  validations  of  new  training  methodologies.  In  addition, 
the  tests  are  now  ready  for  integration  into  a  CMI  system  designed  for  76C 
AIT  course  administration  now  being  acquired  for  the  TTFA. 
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APPENDIX  A 


1. 

2. 

3. 

4. 

5. 

6. 

7. 
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14. 
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18. 
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20. 
21. 
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23. 

24. 

25. 

26. 
27. 


BSEP  Critical  Tasks  for  76C  MOS 
Taak  Number  Title 

76C  101-539-1101  Maintain  a  Prescribed  Local  List  (Manual) 

76C  101-539-1102  Prepare  and  Maintain  Non-stock  List  Records 
76C  101-539-1103  Process  a  Request  for  a  Prescribed  Load  List  Repair 
Part  (Manual) 

76C  101-539-1104  Process  a  Request  for  a  Prescribed  Load  List  Repair 
Part  (Automated) 

76C  101-539-1105  Process  a  Request  for  Non-stockage  List  Repair  Part 

( Manua 1 ) 

76C  101-539-1106  Process  a  Request  for  Non-stockage  List  Repair  Part 

(Au toma ted) 

76C  101-539-1107  Process  a  Request  for  Non-national  Stock  Number 
Repair  Part  (Manual) 

76C  101-539-1108  Process  a  Request  for  Non-national  Stock  Number 
Repair  Part  (Automated) 

76C  101-539-1109  Process  a  Request  for  a  Repair  Part  Designated  as  a 
Direct  Exchange  (Manual) 

76C  101-539-1110  Process  a  Request  for  a  Repair  Part  Designated  as  a 
Quick  Supply  Store 

76C  101-539-1111  Receive  Repair  Parts  (Manual) 

76C- 101-539- 11 12  Receive  Repair  Parts  (Automated) 

76C- 10 1-539-1113  Turn-in  Repair  Parts  (Manual) 

76C-101-539-1114  Turn-Repair  Parts  (Automated) 

76C-101-539-1115  Conduct  Review  and  Inventory  of  Prescribed  Load 
List  (PLL)  Records  (Manual) 

76C-101-539-1116  Process  Prescribed  Load  List  (PLL)  Change  Listings 
Automa ted) 

76C-101-539-1118  Process  Supply  and  shipment  Status  List  of  Cards 
76C-101-539-1119  Initiate  Follow-up  or  Document  Modification  Action 
76C-101-539-1120  Initiate  Cancellation  Action 
76C-101-539-1121  Perform  Reconciliation  of  Due-in 
76C-101-539- 1301  Prepare  and  Maintain  an  Equipment  Log  MOS:  17K 

54E 

76C-101-539- 1302  Prepare  and  Maintain  a  Preventive  Maintenance 
Schedule  and  Record 

76C-101-539-1303  Prepare  and  Maintain  an  Equipment  Uncorrected  Fault 
Record 

76C-101-539-1304  Request  Repair  oi  Modification  of  Equipment 
MOS:  31M 

76C-101-539-1305  Prepare  and  Maintain  an  Equipment  Component  Register 
76C-101-539-1306  Prepare  an  Equipment  Control  Record  MOS:  54E 
76C-101-539-1307  Dispatch  and  Record  Return  of  Equipment  MOS:  76C 
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28  .  760  101-539-1308 

29.  76C- 101-539 -1309 

30.  76C- 101-539- 1401 

31.  76C- 101-539- 1402 

32.  76C- 10 1-539- 1403 

33.  76C- 101-539- 1404 

34.  7 6C- 101 -539 -1405 

35.  76C- 101-539- 1406 

36.  7 6C- 101-539 -1407 
37  76C- 10 1-539- 1408 

38.  760101-539-1409 

39.  760101-539-1410 


Prepare  and  Maintain  The  Material  Condition  Status 
Report 

Prepare  and  Maintain  the  Oil  Analysis 

Process  Complete  or  Rejected  Request  for  Maintenance 

Process  Maintenance  Work  Request  Envelope  and  Update 

Maintenance  Workload  Status 

Process  Complete  or  Rejected  Request  for 

Maintenance 

Process  an  Intra-Shop  Work  Request 
Process  a  Work  Request  in  Shop  Supply 

Maintain  a  Shop  Stock  List 
Maintain  a  Bench  Stock 

Prepare  and  Maintain  a  Parts  Request/ Status 
Register  for  a  Request  (Manual) 

Prepare  and  Maintain  a  Parts  Request/ Status 
Register  for  Status  (Automated) 

Conduct  Review  of  Shop  Stock  Records  (Manual) 
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SCORE.  The  number  of  subjects  responding  to  the  Item  is  listed  in  parentheses.  P  »  proportion  of  correct  responses. 

When  P  =  1.00  or  0,  a  biserial  correlation  cannot  be  computed. 
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